Measuring the Effectiveness of Public Search Engines on Thai Queries

This paper compares the retrieval performance of seven public search engines on Thai queries by using a blind evaluation. Two of the engines used in this study are Thaifocused search services, while the remaining engines are large, commercial search engines that have wider collections of web data and support several languages. The results are compared by Mean average precision (MAP) and Mean reciprocal rank of the first correct answer (MRR). These results are calculated from binary relevance judgments of the first 20 returned results, using 56 topics. Statistical testing shows that there are significant differences among engines.